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Abstract 

In this paper, we establish a super Frobenius formula for the characters of Iwahori-Hecke algebras. 
We define Hall-Littlewood supersymmetric functions in a standard manner to make supersymmetric 
functions from symmetric functions, and investigate some properties of supersymmetric functions. 
Based on Schur-Weyl reciprocity between Iwahori-Hecke algebras and the general quantum super 
algebras, which was obtained in [8], we derive that one of several types of Hall-Littlewood supersym- 
metric functions, up to constant, generates the values of the irreducible characters of Iwahori-Hecke 
algebras at the elements corresponding to cycle permutations. Our formula in this article includes 
both the ordinary quantum case (n = 0) that was obtained in [10] and the classical super case (q— »1). 

1 Introduction 

The Frobenius formula is one of powerful methods to compute the irreducible characters of symmetric 
groups. It is based on Schur-Weyl reciprocity; there are actions of symmetric groups and of general 
linear groups which generate the full centralizer of each other. Schur-Weyl reciprocity has been extended 
to various groups and algebras up to the present. Among them, two remarkable extensions for us are 
the super type extension ([1],[T2]) and the quantum type one ([!]). In our paper [5], we established 
Schur-Weyl reciprocity between the Iwahori-Hecke algebra J^Q( q ) ir (<}) and the quantum super algebra 
Ug n)) , which unifies Schur-Weyl reciprocity of super type and that of quantum type. In [TU] , Ram 

gave a (ordinary) Frobenius formula for the characters of the Iwahori-Hecke algebras of type A, which 
is based on the Schur-Weyl reciprocity between the Iwahori-Hecke algebra of type A and the quantum 
enveloping algebra of gl n that was given in [4]. An extension of Frobenius formula to Ariki-Koike algebras, 
that are Hecke algebras associated to complex reflection groups G(r, l,n), is found in [13 . In this paper, 
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we give a super Frobenius formula for the characters of the Iwahori-Hecke algebras of type A that extends 
the result of Ram. 

As in the Macdonald's book [BJ, symmetric functions play a crucial role in the representation theory of 
symmetric groups. Especially, the transition matrix M(p, s) from power sum functions to Schur functions 
is the character table of the symmetric group. Combinatorial rules to compute character values such as 
Murnaghan-Nakayama formula have been given by making use of properties of symmetric functions. On 
the other hand, various generalizations of symmetric functions are defined until now. Hall-Littlewood 
functions are symmetric functions with one parameter which intermediate between monomial symmetric 
functions and Schur functions. Among several types of Hall-Littlewood functions, The one which is 
denoted by q\(x, q) yields the Frobenius formula for the characters of the Iwahori-Hecke algebra (|10j). 

In order to give a super Frobenius formula for the Iwahori-Hecke algebra, we define the Hall-Littlewood 
supersymmetric functions P\(x/y; q) and q\(x/y, q) and investigate some properties of them in section 2. 
Let x — (x\, X2, ■ ■ ■, x m ) and y = (y±, y%, . . ., y n ) be commutative variables. Using a partition of unity in 
&Q(q),r(o)i that is a complete set of orthogonal minimal idempotents which is specialized to a partition 
of unity in C[6 r ], we derive that the trace of the product of ir r (h)£A q and D r (zB q is R.H.S. of the super 
Frobenius formula (Definitions of 7r r , A q , D r , B q are given in section 3). 

Theorem 4.4. For any ^€^Q( g )(x,3/),r(<7)> 

tr(D r Tr r (h)) =J2x X (h) Sx (x/y), 

where % A is the irreducible character of ^Q(q)(x,y),r(o) corresponding to A. 

We investigate L.H.S. of Theorem 4.4 in section 5. We obtain that when h is the element T 7fc of 
^4}( q )( x .y),r{q) corresponding to the cycle permutation of length k, L.H.S. coincides with qk(x/y; q~ 2 ) up 
to constant. 

Theorem 5.3. 

tr (D fc 7r fc (T Tfc )) = — l—jqkXx/y-^- 2 ). 
q — q 1 

Finally, for the product T 7fi = T 7w T 7(J2 • ■ -T 7ai where /i = (/ii, (12, ■ ■ we have 
Theorem 5.5. For /ihr, 

(q - g-i)'W q ^ x/m g ' 2) = ^ x\T^)s x (x/y). 

Though not all the values of characters can be computed by Theorem 5.5, owing to our version of 
Ram's result 

Theorem 5.6 ([TO], Theorem 5.1). For each T a , ad& r , there exists a T^q^q" 1 ] linear combination 

fihr 
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Oo-^sZfg, q l ], such that x(T CT ) = x( c <j) for all characters \ of J^q(q), r { a )> 

shows that any character of ^Q( 9 ),r((z) is determined by its values on the elements T 7 . 

Our result extends [10j . and may yield new combinatorial rules for computing the irreducible char- 
acters of Iwahori-Hecke algebras. Moreover, as we have pointed out in [5], the super version of the 
representation theory of the symmetric group and the Iwahori-Hecke algebra are more suitable to de- 
scribe the representation theory of the alternating group and its g-analogue. Our result will be used to 
derive a Frobenius formula for the g-analogue of the alternating group which was defined in [7]. 



2 Preliminaries on supersymmetric functions 

Symmetric functions, besides their own interest, play important roles in various areas in mathematics. 
Particularly, the relation between symmetric functions and the representation theory is intimate. In 
this section, we will give supersymmetrizations of various classes of symmetric functions and investigate 
relationships between them. The basic reference of symmetric functions and supersymmetric functions is 
Macdonald's book [5J. We will follow [BJ with respect to our notation about symmetric functions unless 
otherwise stated. 

We denote by 6 m the symmetric group of order ml. Let A m = Z[xi,X2, ■ ■ .,x m ] Sm be the ring of 
symmetric functions of m variables and (A to )q = A m Cg)zQ. One can define an involution 

w : A m — ^ 

by ui(e r ) — h r . Then, as [6] ,1,(2. 13) ,(3.8) , u(p r ) = (—l) r ~ 1 p r and u(s\) = s\> hold. Let x = 
(xi, X2, • • -x m ) be m variables and y = (2/1,2/2, ■• -J/n) n variables. We denote by f{x,y) a symmetric 
function f(xx, xi, . . ., x m , 2/1,2/2, • ■ ■, J/n)sA m + n for abbreviation. According to [BJ,L3,ex.23, we set 

m n 

E x/y (t)=l[(l + x l t)/l[(l + y 1 t). (2.1) 

i=i 3=1 

The elementary supersymmetric functions ek(x/y) (fc>0) is defined by 

E x/y {t) = J2 e k{x/y)t k . (2.2) 

fc>0 

From (2.1), (2. 2), ek(x/y) is a polynomial in x = (x\,X2, ■ ■ -Xm) and y = (2/1, 2/2, • ■ ■, 2/n), symmetric in 
each set of variables separately. We denote by A m) „ the ring of polynomials in x\, X2, ■ ■ -x m , 2/1, 2/2, ■ ■ -JM, 
which are separately symmetric in x's and y's, namely 

A m ,„ = Z[xi,X2, ■ • ■,x m ] &m ®z%>[yi 1 y2, ■ ■ -,2/™] 6 "- 
We also denote by (A TOi „)q = A mj „i$5zQ- w can be regarded as an involution on A m >n which acts on each 
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factor of Z[xi,X2, ■ ■ ., x m ] &ra ®i'L[y 1 , y 2 , ■ ■ .,y n ] 6n as ui. One can deduce from (2.1), (2. 2) that 

e k (x/y)= (-^i^My) (0,1-3, ex.23) 

i-\-j—k 
i+j=k 

Let Lo y be the involution u> acting on symmetric functions of y variables. Then, e^ix/y) is obtained from 
aj y ek(x,y) by replacing each yi by — y{. For each partition A, supersymmetric Schur function s\(x/y) is 
defined by 

s\{x/y) = de^ey.-i+jix/y))^..^ 
where I = /(A'). We readily see that 

efeO/y) = s {lk) (x/y) 

By making use of the equations 

us x/ll (x) = s X '/n'(x) (0,1,(5.6)), 

MCA 



and u>y, one can obtain 



^(s/y) = ^(-1)I a -"I Sm (x) Sa7m ,(j/) (i,I.5,ex.23(l)) 

= XI s i*( x ) s x/i*'(~y)- 



(2.3) 



In a similar manner to (2.1), we define H x j y {t) to be 

m n 

Hx/yW = ri( i - ^y 1 ri( i - ( 2 - 4 ) 

and the completely supersymmetric functions hk{x/y) (fc>0) to be 

H x/y {t) = Y J hk{x/y)t k . (2.5) 

fc>0 

One can deduce from (2. 4), (2. 5) that 

hk(x/y) = X hi(x)ej(-y) = e k (-y/ ~ x). 

i+j=k 

Moreover, applying lo to hk{x/y), we have 

ujh k (x/y)= X whi(x)uej(-y) = ^ ei(x)hj(-y) = ek(x/y) = s^(x/y). 

i-\-j=k i-\-j—k 
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Hence we obtain 

hk{x/y) = ajs {lk) (x/y) = s {k) (x/y). 
We may also define the power sum supersymmetric functions pk(x/y) (fc>l) as follows. 

Pk(x/y) = u y p k (x, -y) 

= p fe (x) + (-i) fc -V(-y) 
= Pk(x) -Pk(y) 

In the same way as [6], I, (2. 10), we obtain the following relation for the generating function P x / y (t). 



r>l 



r>l i—1 r>l i—1 

rn n 

%i \ ^ yi 



Thus, we have 



1 - Xit ~ ^ Y- y t t 

i=l 1 i=l yl 

m J i n J 1 

Ed 1 " i >- 
— log > —log 
eft; b l~ Xi t ^ dt 1-Vit 

i=l 1 i=l yl 

, m n 

<=1 3=1 

dt l0 * H ^ = J^y 



H x / V (t) = exp(^p r (a;/y)— ) 

r>l 

4T 

= [[exp(p r (x/y)—) 

r>l 

= -Q ^ (PrCaj/j/)* 1 ") 



^ \ r m T 
r>l ra r >0 



where m, is the number of appearances of i in Ai, A2, . . ., \{\)- Let A? = Y\i>i i mi fni\- Then 



summed over all partitions A. On the other hand, 

H x/y (t) = ^h k {x/y)t k , 



k>Q 
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so we can conclude that 

hk{x/y) = 2^ — T7 — • ( 2 - 6 ) 

Ahfe 

We notice e r {x/y) and h r (x/y) are denned to be zero if r < 0. 

By an analogy of the case of symmetric functions, we will use the following equation later to give a 
super version of the Frobenius formula for the characters of Iwahori-Hecke algebras. 

Theorem 2.1 (Super Jacobi-Trudi formula. [IT], (1.9)). Let Ahr. Then 

s\{x/y) = det[/i Ai _ i+J (x/y)] 1 < ij < r 
In [TT], the above formula is given for the hook-Schur function 

HS x (x;y) = s Jtl (a;)s A / / ^ (y), 

pCX 

which is different from s\{x/y) slightly. But replacing y with —y, Theorem 2.1 is obtained from [llj 
immediately. Super Jacobi-Trudi formula is also found in [9] . 

Let A^ n be the subspace of A m) „ consisting of r homogeneous polynomials. For arbitrary reN, we 
define a map tp from & r to A^ n as follows. 

i>M =p P (w)( x /y) = Ppi(x/y)pp 2 (x/y)---Pp l{p) (x/y) 

where p{w) = {pi,p2, ■ ■ •Pl(p)) i s the cycle type of w. Let vxw£& ri x6 rr Then vxw can be embedded 
in & ri+r2 in many ways. Nevertheless, for the same reason as in 1.7 in [6j, we have 

tp(vxw) — ip(v)ip(w). 

In general, for functions /, g on a finite group G which values in a commutative Q-algebra, the scalar 
product of / and g is defined by 

(f,9) = T^Y,f^9(x- 1 )- 

11 x£G 

Let Irr(G) be a basic set of irreducible C-characters of G and ch(C[G]) = ©£ 6 i rr Z£ the Z-module of 
virtual characters. For /.j£lrr(6 ri ) (i = 1,2), we define /i-/ 2 G ch(C[6 ri+r2 ]) to be 

/r/ 2 =ind^; + x "| i . 2 (/ 1 x/ 2 ) (2.7) 

Then, as in [5] ,1.7, the Z-module 

C h(c[e]) = 0ch(c[e r ]) 

r>0 

has a ring structure with the product (2.7). By an analogy of the characteristic map as in [B],1.7, we 
define a Z-linear map 

sch:ch(C[S]) — >(A 



G 



sch(/) = (/^) Sr = l y, /ww^/w 1 



where /(/x) is the value of / at elements of cycle type \x. Using Frobenius reciprocity, we obtain 

sch(/ r / 2 ) = (indj;; + x ''| r2 (/ix/ 2 )^} e ,. i+i . 2 

= <(/ix/2),rese^+ r |^ W>)) Sri xe r2 
1 



|e n ||6„| E (Ax/ 2 )(,x^( 

1 111 21 vxwee ri x6 r 
1 

|6 ri ||6 r2 

1 ' 1M ' 2 «es ri ,«)e6». 



vxw) 



Y h{v)f2{w)tl){v)lp{w) 



= sch(/i)sch(/ 2 ). 
Therefore sch is a ring homomorphism. 
Proposition 2.2. 



where \ X is the irreducible character ofC[& r ] corresponding to A. 

Proof. Let r\ r be the identity character of 6 r and ry. r = if r < 0. Then by (2.6), 

t-^ III 

For A = (Ai, A 2 , . . ., A;)hr (I = Z(A)), let rj\ — rjx 1 -rj\ 2 r/\ l be the character 

tix = indg ; iXSxiX ... xSxi (v\i -XV\2 * • ■ -x*?**, ) 

of & r . Then we have sch(r/x) = h\(x/y). From [5] ,1,(7.4), (7.6) (i), x X = <te*-[VXi-i+j]i<i,j<r- Using 
Theorem 2.1 one can deduce 

sch(x A ) = detlhxi-i+jix/yJltKijKr = s\(x/y), 
while the definition of sch yields 



sch( X A ) = 5> A (M) 



Pn( x /y) 



/xhr 

□ 
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Let 

1 - q l 
(1 



v m (q) = n y 



=1 
and 



i=l 

for A = (Ai, A2, • • .A m )hr, l(A)<m, (in which some of the A^ may be zero). The Hall-Littlewood symmetric 
function P\(x; q) for the variables x = (x±, X2, ■ ■ ., x m ) is defined by ([B] ,111,(2.1)) 



v x (q) ^ V 1 1 m H x t - Xj 

P\(x\ q) is defined to be zero if 1(A) > m. P\(x; q), l(A)<m constitute a basis of (A to )q( 9 ) = A T , 
Let ip r (q) = nLiC 1 ~ q l ) and 

& a(<?) = JJ^w(?)) 

i>i 

where m^(A) = ^{j : | Aj = i}. Another Hall-Littlewood symmetric function Q\(x;q) is defined by 

m ,111,(2.11)) 

Q\(x;q) = b x (q)P\(x;q). 

P\(x; q) and Q\(x; q) are homogeneous of degree |A|. Furthermore, two other symmetric functions q r (x\ q) 
and q\ (x; q) for a partition A = (Ai, A2, . . ., A;(x)) are defined by 

q (x\q) = 1 = Po(a;;g) 

m 

9r (x; q) = (1 - q)P (r) (x; q) = (1 - q) £ x\ J] (r>l), 

■ . , . X j 

q\{x;q) = Y[q\A x ;q)- 

i=l 

As in [5] ,111, (4.8) , we may define a scalar product on (A m )Q( g ) by requiring that the bases (q\(x;q)) and 
(m,\,(a:)) be dual to each other: 

(q\(x;q),m M (x)} = 6\ iPl 

Then one can see 

(P X (x;q),Qx(x;q)) = S x ^ (0,111,(4.9)). 
The generating function Q(u) of q r (x; q) is 

in 1 

Q(u) = <&•(*; <zK = n — ([6j,in,(2.io)). 

^ ~ J- XiU 



r>0 i=l 
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In the similar manner as (2.1), we define a supersymmetric function q r (x/y; ?)€A m) „ as follows. 

1 — XiqU -y-r 1 — UjU 



Qx/ y (u) = V q r (x/y; q)u r = TT — TT - 

L — 1 ±A - 1 — XiU 1 — ll j OIL 

From the definition of q r (x/y; q), we immediately have 



qr(x/y;q) = ^2qk(x;q)q r -k(qy;q l ) = ^2,<f k qk(x;q)q r -k(y;q (2.8) 

fc=0 fc=0 

In order to define the Hall-Littlcwood supersymmetric functions, we shall give a definition of the skew 
Hall-Littlewood symmetric functions Px/^x^q) according to [6J ,111,5. P\/^{x]q) is a symmetric function 
which is uniquely determined by 

(Px/^(x; q), Qu(x; q)) = (P\{x; q), Q^x; q)Q v {x] q)) (2.9) 

More constructive way of definition is as follows. For two partitions A, /i such that A — /i = 9 is a horizontal 
strip, let J e = {jeN \ B' 3 < 6' j+l ] and 

where rrij(fj,) = \ \Xi = j}. For general A,/i, take a semi-standard tableau (it is called "column-strict 
tableau" or simply "tableau" in [B]) T = (fi = XqCXiC- ■ -cA ( = A) and set 

i=l 

Then P\/^{x] q) is defined by 

P\/»(x;q) = ^2^T(q)x T 

T 

summed over all semi-standard tableau T of shape A — /i. 
Lemma 2.3. For < k<r, 

P {r)/[k) (x;q) = {l-q) l(u) m v {x). 

v\-r — k 

Proof. Let A = (r) and /i = (k), and consider a semi-standard tableau T — (/i = AoCAiC- ■ -cA; = A). 
In each ^Xi/Xi-Al)-* we readily see that Je = {|A,-i|} and "t-| Ai_i | (^i— i ) = 1 if Ai-iCA,; and Je — <f> if 
= Xi- Therefore, for each semi-standard tableau T, ipT(q) = (1 — q)^ 1 ' Ai - 1 £ Ai h Summing up all 
semi-standard tableaux, we obtain the equation. □ 

Lemma 2.4. 

P(r)/o(x;q) = P( r )(x;q), 

P(r)/(r)(x;q) = 1 

P(r)/(k)(x;q) = (1 - q)P( r -k){x;q) (0 < k < r). 
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Proof. The first equation is direct consequence of (2.9). The second is obtained from Lemma 2.3. For 
the third, we use [6],IIL2,Ex.3, 

r-l 

P(r)(x;q) = ^2(-qys {r _ lA i } (x). 

i=0 

Since the transition matrix M(s, m) equals to (Kx^) consisting of Kostka numbers, the numbers of 
semi-standard tableaux of shape A and weight fj,, we have 

i — k—l 

P(r-k)(x;q) = ^2 (~ q Y E K {r-k-i,x*)vm v {x). 

i—Q u\-r — k 

By [B],L6,Ex.2(b), 



■^(r — k — i,l l ) v 



- 1 



So, observing that l(y) — l<r — k — l, and that if l{v) — 1 < i then 1 ) = 0, we obtain 



v\-r~k i— o x 

On the other hand, from Lemma 2.3, 

P(r)/(k)(x;q) = Y ( X ~ ?) 

v\~T—k 

= {i- q ) J2 (i - q) 1 ^- 1 ™^) 



v\-r — k 

l(u)-l 



v\~r — k i—0 



a-*) E_{ E 



Lemma 2.5. For r>l, 

wP (p) (a:;g) = {-ly-^P^qx^q- 1 ) 



□ 
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Proof. From (2.25), we have 

r-1 

LoP {r) (x;q) = uj^2(-qys( r „ iyli) (x) 

i=0 
r-1 

i=0 
r-1 

i=0 
r-1 

r-1 

= (-g) r - 1 E(-«)~ J ' fl ('-i.i J )( a; ) 

= (-l)' r - 1 g- 1 P (r) ( (Z .T; (Z - 1 ) 
It is known ([6J,III,(5.5')) that 

P\{x,y;q) = ^P li {x- 1 q)P\/ p ,{y;q). 

AiCA 

We define the Hall-Littlewood supersymmetric functions P\(x/y;q) to be 

P\{x/y;q) = u y P x {x, -y;q) = P^x; q)uP x/f ,(~y; q). (2.10) 

(J.CX 

When q = 0, R.H.S. of (2.10) reduces to that of (2.3). Hence we obtain P x (x/y;0) = s\{x/y). 
Proposition 2.6. 

Po(x/y;q) = q Q (x/y;q) 

P(r)(x/y,q) = - q r (x/y;q) (r>0). 

1 — q 



□ 
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Proof. The first equation is obvious. From Lemma 2.4, Lemma 2.5 and (2.10), for r > we have 

r 

P{r) (x/y; q) = ^2 P( k ) {x; q)ujP (r) /( k) (-y; q) 

1 — 1 

= wP (r)/(0)(-S; 9) + X! F M ( X 5 <l)uP{r)/(k) (-2/; 9) + -P(r) fa 9) 
fc=l 
r-1 

- (-l) r u;P (r) (y; g) + £ ^(fe) fa 9) (-l) r " fe (l - l)uP{r-k) {v\ ?) + ifo fa «) 
fe=i 

= (-«) _1 -P(r)(g2/;« _1 ) + X! p ( fc )( a;; ' ? )( 1 ~ 9 _1 )-P(r-)fc)(3y;9 _:L ) + -P(r)(z;<7) 

fc=l 

1 r_1 1 1 

= -, 9r(gy;<7 _1 ) + Y] q k {x;q)q r - k {qy;q^ 1 ) + q r (x;q) 

1-q l~i q Q 



q r {x/y;q). 



i-q 



□ 



3 Iwahori-Hecke algebras and general quantum super algebras 

In this section, we review the sign g-permutation representation of the Iwahori-Hecke algebra Jtf q of type 
A ([5]), and the vector representation of the general quantum super algebra U° ([I], [5]). 

Let R be a commutative domain with 1, and let q be an invertible element of R. The Iwahori-Hecke 
algebra J#R ir (q) of type A is an i?-algebra generated by {Ti i — 1, 2, . . . , r — 1} with the relations: 

(HI) Tf = (q-q- l )Ti + l if % = 1, 2, . . . , r - 1, 

(H2) T.jTi + iTi = T i+1 TiT i+1 if * = 1, 2, .... r - 2, 

(H3) /;/, /,'/; if \i-j\ > 1. 

Let R = Z[g,(7 _1 ] be a polynomial ring over Z with indeterminates g ±:L , and if the quotient field of R. 
Let M = (B^iRvk be a Z2-graded _R-module of rank m + n. By Z2-graded, we mean that M is a direct 
sum of two submodule Mq = ®™ =1 Rvk and My = (B^m + l^fej an d that for each homogeneous element 
the degree map |-| 

if vGMq, 



1 if veM T , 



is given. 
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Let 7r r be the g-permutation representation of J%R^ r (q) on the tensor space M® r . As defined in [5], 7r r 

V 

I'.v 



is given by 7r r (Tj) = Id®' -1 giTfgild®" 1 (i = 1, 2, . . . , r - 1) where T is the operator on M<g>M defined 



-1 

Vk®vi if fc = Z, 



7>A - ^ (-ljMWwj®^ + ( g - g- 1 )^®^ if k < I, 
(-l)MMvi<g)v k iffc>Z. 

and Id is the identity operator on M. This representation 7r r is reduced to the (normal) g-permutation 
representation of J^B.,r(q) with n = and to the sign permutation representation of the symmetric group 
& r with q—>l. For abbreviation, we denote J^ q = ^k,r{q) = K<S>R^R, r (q) and set V = K<E>rM. The 
above action also defines a representation of Jlf q on V® r . 

Next, we define the quantum superalgebra U°($l{m, n)) and its vector representation on the tensor 
space V® r according to pQ. L^(gl(m,n)) is a Hopf algebra obtained from the quantum superalgebra 
U q (gl(m,n)^ , which is a Hopf superalgebra, by adding an involutive element a. 

Let P — ©hgaZej, be a free Z-module where B = B + UB_ with B + — {1, . . . , to} and £?_ = {m + 
1, . . . , to + ti}, and IT = = ej — e;+i}ie/ a set of simple roots with the index set I — I cvcn Ul odd where 
-^cvcn = {1, 2, . . . , to — 1, 777 + 1, . . . , 777 + 77 — 1} and I dd = {to}. We define a map p : / — >{0, 1} to be 
such that 

if i£l cvcn , 

1 if ie/odd- 



p(i) 



A Q-valued symmetric bilinear form on P (•, •) : PxP — >Q is defined as follows. 

1 ifa = a'eB + , 
(e a ,ta>)={-l ifa = a'eB_, 
otherwise. 

The set ±l v = {hi\i£l} of simple coroots is uniquely determined by the formula £i(hi, A) — (a;, A) for any 
XgP, where (•, •} is the natural pairing (•, •} : P*xP — >Z between P and P* and 

1 if i = 1, . . . , to, 
— 1 if i = to + 1 , . . . , to + 77 — 1 . 

The quantized enveloping algebra Ug[Ql{m, n)J is the unital associative algebra over K with generators 
q h (h€P*),ei, fi(i€l) and an additional element a which satisfy the following defining relations: 

(Ql) q h = 1 for h = 0, 

(Q2) q hl q h2 = q hl+h2 for hi,h 2 eP*, 

(Q3) q h e l = q^ a ^e iq h for heP* and iel, 
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(Q4) q h U = q- {h - a i ) f i q h for heP* and iel, 

qUhi _ q-lihi 
(Q5) [ei,fj] = S. tj — T -j- — for i,jel, 

(Q6) a 2 = 1, 

(Q7) q h a = aq h for heP* , 

(Q8) e iC r = (-l)PWo- ei for iel, 

(Q9) /iff = (-l)*®afi for iel, 

where [e^/j] means the supercommutator 

[e i ,fj] = e i f J -(-l)*«)*®f j e i . 

We assume further conditions (bitransitivity condition, see [5] p. 19): 

(Q10) If ae ^j( n +) e j^<j( n +) satisfies fiaeU q (n + )fi for all iG/, then a = 0, 

(Qll) If aG X)ie/ C^g( n -)/iC^g( n -) satisfies e i aG?7 g (n_)e i for all then a = 0, 

where J7 9 (n + ) (respectively C/ g (n_)) is the subalgebra of U^[Ql(m, n)) generated by {ei\iel} (respectively 
{fi\i£l}). Uq(gl(m, is a Hopf algebra whose comultiplication A, counit e, antipode S are as follows. 

A(<t) = Cr<g>CX, 

A(g' 1 ) = q h ®q h iovheP*, 

A(e,;) = ei®q~ U}H + cr pW ®e; for iel, 

A(/i) = + cr^Y^Wi for *e/, 

e(cr) =£(<?'') = 1 for/ieP*, £(ej) = e(/i) = for iel, 

5(a) =<r, 5(g ±h ) - g Th for /ieP*, 

S(ei) = -a^e iq tih \ S(f { ) = -a^q'^ fi for iel. 

For the sake of abbreviation, we denote (gl(m, ti)) by Z7^. The vector representation (p, V) of [/^ on 
Z 2 -graded vector space V = Vg©Vi (recall that Vjj = ©^floi, = ©™ tT+i^) is defined by 

p(<r)vj = (-l)'" 3 '^- for j = 1, . . . ,m+ n, 
p{q h )vj = q^'^vj for heP*,j = 1, . . . ,m + n, 

P( e j) V j+l = U i f° r J = 1,. ..,771 + 71, — 1, 

= for j = 1, . . . , Til + 7i - 1, 

otherwise 0. 
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This representation can be extended to the representation on the tensor space V® r . Let p r be the map 
from XJ a q to End K (V r ® r ) defined by 

p r (a) = p(*f r , 

Pr(q h ) = p{q h T r iorheP*, 
N 

PM) = £p(o*< i >)®*- 1 <Me<)®P(?~' lh< ) S9r ~* for i€l, 

k=l 
r 

Pr(fi) = ^pK«^ hi )®^ 1 ®P(/i)®Id 8r - fc for ieJ. 
k=l 

Let A' 1 ' = A and set A( fe ) = (A® Id®^ 1 ) A (fe_1) inductively. Then from the definition of A, we have 
p r (g) = /9® r o A( r_1 )(<7) for gG/7g immediately. 

Proposition 3.1 (pQ Proposition 3.1). p r gives a completely reducible representation ofU q on V® r for 
r>l. 

We denote 7r r (jf^) by A q and p r {U°) by £> g . In [5], we have shown that >l g and £> g are full centralizers 
of each other in Endif V® r . Namely, 

Theorem 3.2 (0 Theorem 4.4). End Bg V® r = A q and End A V® r = B q . 

We denote by K the algebraic closure of K. We set M \ = J^ q <S>KK, = U°®kK, A q = A q ®KK, 
B q = B q ®KK. Then, n r (jFq) — A q and p r (U^) = B q as if-algebras of operators on V® T = (V(S>kK) 0v . 
Let H(m,n;r) = {A = (Ai,A2, • • -)^r\\j<n if j > m}. Diagrams of elements of H(m,n;r) are exactly 
those contained by the (m, n)-hooks. 

Theorem 3.3 ([8J Theorem 5.1). V® r = ® XeH(m>n;r) H X ®V X where, 
H\ (Asi?(m, n; r)) are mutually non-isomorphic simple Jt? q -modules, 
V\ (A&H(m,n;r)) are mutually non-isomorphic simple U q -modules. 

In fact, Theorem 3.3 holds over K since it is known that if is a splitting field for Jff q . Hence J4? q is a 
split semisimple if-algebra, and we do not need to take the algebraic closure. 

4 Traces of the actions of Jif q and U% 

In this section, we introduce indeterminates x\, . . ., x m , yi, . . .,y n associated to the basis V\, . . ., v m+n and 
consider the trace of the product of two operators D r €B q and ir r (h)€A q with h(zJ4? q , in the same manner 
as in [10] or [13] . Using a partition of unity of J4? q which has been given in [3] and [14] independently, we 
obtain that the trace generates characters of Jtf q . Regarding C[6 r ] as the specialization of J4? q to 1, we 
use same notations such as 7r r ,x A ,etc, for C[(E5 r ]. 
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Let K' = K(zi, Z2, ■ ■ ., z m+n ) be the field of rational functions on K . In the remainder of this paper, 
we assume that Jrifq, U q , V, etc., are defined over K' and use the same notations such as Mq,U q , V, etc.. 
We notice that Proposition 3.1, Theorem 3,2, Theorem 3.3 are hold for K' . Let 

^r,m+n = {l = (h,h, ■ ■ ; V) I l<«fc<™- + Tl} 

J+m+n = {i = (nj*2, ■ ■ ■, v) I l<ik<m + n, i\<i 2 <- • -<i r } 

and 

%,m+n — {c = (Ci, C 2 , . . ., C m +n) | C/c>0, J^Cfc = r} . 

For i = (ii,i 2) ■ ■ ■,v)eJ^ ! m+m w g define c(i) — (ci, C2, ■ ■ ., c m ^„) where k appears c k times in i\, ?2 ; ■ ■ -,i r 
for each fe = 1, 2, . . ., m + n. Clearly c maps J^ r ,m+n onto ff^m+n- Let .EjG EndA'' V (i = 1, 2, . . .m + n) 
be the projections, 

EiV k = 5 lk v k . 

We set Vi — Vi^v^® - ■ -®Vi r and 

c(i)=c 

for cG^ r!m+ „. Then E c is the projection from V® r to the subspace V^ 1 " which is defined by 

v ®r = K'Vi. 
c(i)=c 

By an easy calculation, we see that Ei®Ej + Ej®Ei = 1, 2, . . ., m + n) commute with T on V® 2 . For 
each term 

E h ®- ■ ■®E ik _ 1 ®E lk ®E lk+1 ®E ik+2 ®- ■ -®E ir 
of E c , there exists a term such that 

E h ®- ■ ■®E ik _ 1 ®E %k+1 ®E ik ®E ik+2 ®- ■ -®E ir 

in E c . Hence E c commutes with the action of J4f q , namely, E c belongs to End_4 ? V® r — B q — p r (U q ). 
Let z c = z^z^ 2 - ■ ■z^+'n an( i define an operator D r on V® r by 

D r = zCE - 

As mentioned above, we have D r G End^ 5 V® r . In the same manner as in the proof of Lemma 3.5 in [TO] , 
one can show: 

Lemma 4.1 f [10j Lemma 3.5). For any idempotent p£J%q, tr (-D r 7r r (p)) is independent of q. 

Let us define the specialization to a nonzero complex number t to be a ring homomorphism ip t : R — >C 
with the condition <pt(o) — t. C becomes (C, i?)-bimodule, with R acting from the right via iff By 



1G 



the specialization <f t , one has C®R34?R, r {q)=Mfc tr {t), especially, if t = 1 then C®RJtjt, r (q)—C[& r ]. 
We denote by M t = C®rM the specialization of M by ft- If i is a transcendental number, then 
K=Q(t) as fields via Q-homomorphism gi— >t. Therefore, we have K=Q(t)=C as fields. Let C = 
C(zi, 22) ■ ■ * 7 z m+n ). Then J%c',r{t) is a split semisimple C'-algebra. We may assume that Mi is defined 
over C. We replace zi, z 2 , ■■■,z m by xi, x 2 , ...,x m and z m+i , z m+2 , . . ., z m+n by -j/i, -y 2 , ■ • •, ~Vn- Then 
we have the following two lemmas in a similar way as in the proofs of Lemma 3.6 and Lemma 3.7 in [10] . 

Lemma 4.2. Let 7 r = s\S2- ■ -s r _2Sr— lE&r- Then 

m n 

tr (D r 7r r (7 r )) = ^< + (-l) r_1 ^(-yi) r =Pr(^) -Pr(y) =p r (x/y) 

i=l i=l 

where D r TT r (^ r ) is regarded as an operator on Mf r . 
Proof. Since 

the coefficient of i^®^®' • in •D r 7r r (7 r )'Uj 1 g)'Uj 2 <8>- ■ '®Ui r is as follows. 

a;^ if ii = «2 = • • • = i r <™ 

<od. = ^ (_l)r-X(_ yii )r if il=i2 = ... =ip>m 

otherwise. 

□ 

Lemma 4.3. Let pa a minimal idempotent of C[& r ] corresponding to a simple left C[& r ] -module 
indexed by Ahr. Then 

tr (D r ir r (p x )) = s x {x/y) 
where s\(x/y) is the super symmetric Schur function. 

Proof. Let z\ be the minimal central idempotent of C[6 r ] indexed by A, and \ X the character which is 
afforded by C[6 r ]pA- z\ is given by 

ae& r 

Let d\ be the degree of C[& r )p\- C[6 r ] contains just d\ simple left C[6 r ]-modules which are isomorphic 
to C[& r ]p\- Thus we have the following. 

tr (D r Tr r (p\)) = i tr (D r TT r (z x )) 

E X A (a)tr(^ r7 r r (a)). 



c?a r. . _ 

crGfev 
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Let p = (/ii,/i2, . . -pi)\^r where / = is the length of /i. We set cycle permutations as follows. 

7m =(12... /ii) 

7m2 = (Mi + 1 Mi + 2 • • • Mi + Ma) 

7« = (Mi H 1- MJ-i + 1 Mi H 1" M;-i + 2 . . . r) 

7p = 7pi7p 2 - ' -7/*i 



classes C M . Hence 



Since x X {°~) an d tr (.D r 7r r (<7)) depend only upon the cycle type \i of a, they are constant on conjugacy 

tr (D r 7r r (p A )) = ^ J! tr (^WTm)) 

1 Km) 

= H^ xA(M) Il tr (• D r7T r (7 M J)|C , M | 
/^hr fe=l 



fihr k—1 

^ M ? 

From Proposition 2.2, we have tr ( y D r / n r {p\j) = s\{x/y) as desired. □ 

In the same way as in the proof of Theorem 3.8 in [10j . we have 
Theorem 4.4. For any h£Mq, 

tr{D r 7T r (h)) = Y J X X {h)sx{x/y) ) 

Ahr 

where \ X is the irreducible character of ,3#q corresponding to A. 

Proof. Let {p^ | Ahr, i — 1, 2, . . ., d\ = dimV\} be a partition of unity in M'q such that when we apply 
the specialization ipi, p\ are well-defined and yield a partition of unity in C[6 r ]. Then we have 

d\ d „ 

tr(D r n r (h))= ^2J2 tT ( Dr7r r(Pi h Pj)) 

X,fi\-r i—1 j — 1 

= E £MA-*r(pfrjtf)) 
X.fj,\-r i—1 

dx 

Ahr i=l 
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where h\ is the diagonal element of the representation matrix of h in the irreducible representation 
corresponding to A determined by this partition of unity. Thus by Lemma 4.3, we obtain 

dx 

Ahr »=1 

= Y.x\h)s x {x/y) 

Ahr 

□ 

5 The super Frobenius formula for the characters of J^f q 

In this section, we compute tr(Z) r 7r r (/i)) in detail. We shall show that when h is a product of elements 
corresponding to cycle permutations, the trace coincides with a Hall-Littlewood supersymmetric function 
up to constant. There is no notion of cycle type for elements of J^ q in general, so not all character values 
are given in this way. Nevertheless, by Ram's result, any character of is determined by its values on 
elements corresponding to cycle permutations. 

For i = {i\,i2, ■ ■ .Zr)£=A\m+n, we define cardinalities of subsets of {11,12, ■ ■ ir} as follows. 

JV°(i) = #{j\ij<m}, N\i) = > m}, 

E°(i) = = ij+uijKm}, E\i) = #{j\ij = > m}, E(i) = 

L°(i) = < i j+ i,ij<m}, L\i) = < > m}, L(i) = L°(i) + L 1 (i). 

Let T lr = T 8l T S2 - ■ ■T Sr _ 1 . Using above notations we obtain: 

Proposition 5.1. For l<k<r, the trace of D k TT k (T^ k ) on V® k is given by 

Proof. We prove by induction on k. If k = 1, then T 7l = 1, so the statement holds obviously. Now 
assume k > 1. We consider Z?fc7rfc(T 7fe )wj 1 (gWj 2 (g>- ■ -®Vi k case-by-case depending on the relation between 
ik-i and i k . 
case 1 : i k ~\ > ik 

D k TT k {T lk )v^®v i2 ®- ■ •«w lfc _ 1 «w 4fc = {-l)^-^ v ^D k iT k {T lk _ 1 )v ll ®v t2 ®- ■ -®v tk ®v lk ^ 

Since ir k (T lk _ 1 ) acts on the first k — 1 factors and i k -i^i k , the coefficient of v il ®Vi 2 'S)- ■ ■®Vi k _ 1 ®v ik in 
DkiikiT^^Vi^Viz®- ■ -<gw ife is zero, 
case 2 : i k -\ < i k 

D k TT k {T lk )v^®v i2 ®- ■■®v ih _ 1 ®v ih = (-l) lv ^-i llv * kl D k n k (T^ k _Jv n ®v l2 ®---®v lk ®v tk _ 1 

+ {Q- q^ 1 )D k 'K k (T lk _ 1 )v tl ®v %2 ®- ■ ■®v lk _ 1 ®v ik 
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For the same reason as case 1, the coefficient of Vi 1 <8>Vi 2 (£)- ■ ■<B>Vi k _ 1 ®Vi k in the first term is zero. While 
the one in the second term equals to the coefficient of w^®^®- ■ ■®Vi k _ 1 in (q — q )zi k D k ^iTr k _i(Ty k _ 1 ) 
Vi^V^®- ■ ■®v ik _ 1 . 
case 3 : i k —i = ik 

(-l)KI(o + q- 1 ) + (q- q- 1 ) 
Dkir^T^Vi^v^®- ■ ■®Vi k _ 1 ®v ik = D k TT k (T lk _ l )v il ®Vi 2 ®- ■ ■®v ik _ l ®v ik 

Thus the coefficient of v^®^®- ■ -®Vi k in D/-7Tfc(T 7) .)«j 1 ®'Vi 2 ®' • -®Vi k equals to that of i;^®?;^®- • ■®Vi k _ 1 
in qz lk D k -iiT k -i{T~ fk _ 1 ) v tl ®v i2 ®- ■ ■®v ik _ 1 if i k <m and to that of v tl ®v i2 ®- ■ ■®v ik _ 1 in -q~ x Zi k D k -\ 
ir k -i(T lk _ l )v il ®Vi 2 (&- ■ ■®v ik _ 1 if i k > to. 

By induction, the assertion follows as desired. □ 
Replacing z\, z 2 , ...,z m by Xi,x 2 , ...,x m and z m+1 ,z m+2 , . . ;Z m+n by -y±, -y 2 , ■ ■ ., -y n , we obtain 



£{£ 9 |A| -' (A) (? - r^'^mxW £ (-q- 1 ) 1 " 1 - 1 ^^ q-'f^m.i-y)} 

3 = 1 Ahj" n\-k—j 



Ahfe 



Let 



?) = g fc £ — q —) m x (x) if fc >0, 

and qo(x; q) — 1. Since mA(£Ei, ■ ■ x ra ) = if 1(A) > m, q k (xi, . . ., x m ; q) = if to = and fc > 0. From 
definition of q k (x; q), one can describe the trace as follows. 



tr(J> fc 7r fc (r 7 J) = — — x ^qj(x;q)q k -j{-y,-q (5.1) 
q q j=0 

Considering the generating function of q r (x;q), we obtain the relation between q r (x;q) and q r (x;q) as 
follows. 

Lemma 5.2. 

g r (x; q) = q r (qx; q~ 2 ) = q r q r (x; q~ 2 ) 

This equations are found in [10j,Theorem4.13 and [13], (6.11.3) in slightly different forms, but essentially 
the same. 
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Proof. Consider the generating function of q r {x; q). 

7-SK/" 

q 



^q r (x;q)u r = ^^{H ( ~ J ) ^ "V( x )} 

r>0 r>0 /J.hr 

q-q- 1 1 <?-9 _:L 



(j 1 — quxi 



n(- 

-r-r 1 - g 1 MXj 

1 - quxi 



1 — q 2 qXiU 



^2q r (qx;q 2 )u r 
r>0 



Thus the equalities hold. 
Theorem 5.3. 



r>0 



tr (D k ir k {T lk )) = - _ ^_ i qk (x/y:q- 2 ) 



Proof. From (5.1) and Lemma 5.2, we obtain 

k 

q-q 



tr (D k n k (T lk )) = - 1 ^q 3 {x; q)q k -j(-y, -q l ) 
q j=o 

1 k 

= _ _! ^qj{qx;q 2 )qk-j{q 1 y;q 2 )- 

q q j=0 

On the other hand, by (2.8), we have 

k 

q k (x/y;q- 2 ) = ^2q j (x;q~ 2 )q k - j (q~ 2 y;q 2 ) 

3=0 
k 

= ^2'ij(x;q~ 2 )q J ~ k qk-j(q~ 1 y,q 2 ) 

j=o 

k 

= q~ k ^2qj(qx;q- 2 )q k -j{q~ 1 y;q 2 ). 



3=0 

This completes the proof. 
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A finite sequence a — (a\, a^, ■ ■ ., a/) of positive integers which satisfy ot\ + a-2 + • • • + a/ = r is said 
to be a composition of r and denote by a\=r. We set cycle permutations for a as follows. 

7 ai = (12...ai) 

7a 2 =(ai + lai+2...ai + as) 

7aj = («i H 1- "/-I + 1 "l H 1- a i-i + 2 • ■ ■ r) 

Then one can readily see that T 7a = T 7cii T 7q2 • • -T^ . 
Proposition 5.4. 

i 

tr (A-7r r (T 7 J) = JJtr (D ai TT ai (T la .)) 
i=i 

Proof. It is sufficient to prove for I = 2. Let T la = T~ fai T~ fa2 . Ty and T 7a2 act only on Vi^v^®- ■ •<8>«i ct 
and «i a +1 ®Wj ai+3 ®- • •®Wi , +01 respectively. Therefore, 

<8>(A, 

2 7T a2 

(27a 3 ) V ia 1 +i® l '»c»i+a®' ' ■® u i« 1+0 , 2 )' 

Thus we have proved the assertion. □ 
Theorem 5.5. For /ihr, 



%{x/y;q 2 ) = ^x X {T ly )s x (x/y) 



Proof. The assertion follows from Theorem 5.3 and Proposition 5.4. □ 

By Theorem 5.1 in |10j . with a slight change for our version, we obtain that any character of Jt? q is 
determined by its values on T 7jj , /ihr. 

Theorem 5.6 ([TD], Theorem 5.1). For each T a , a£& r , there exists a 7h\q,q~ x \ linear combination 



o CTA ,6Z[q, q 1 ], such that x(T CT ) = x( c <j) / or °^ characters \ of Jf? q . 
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